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Abstract 



PROBLEM TO BE SOLVED: To obtain a method, in which audio information from an audio/video source is 
automatically transferred and a speaker is identified simultaneously, by tranferring the audio source, 
simultaneously identifying latent segment boundaries and assigning a speaker label to each identified 
segment. 

SOLUTION: The method includes a step, in which a transfer is made for an audio source to generate a text 
version of audio information, a step which simultaneously identifies latent segment boundaries, and a step in 
which a speaker label is assigned to each of identified segments. A simultaneous transfer, segmentation 
and speaker identification process 500 generates a transfer of audio information, which represents a 
speaker related to each segment, in real time. A segmentation process 600 identifies all frames in which 
segment boundaries may exist. A speaker identifying process 700 assigns a speaker label to each of the 
segments that use registered speaker databases. 
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6ft£C<btC<£oT (x, x.) #2o(D4*»ft 

[0 0 3 4] x, ER d r*^>CD-r. -tf^ttk^d 
+ d (d + 1 ) /20^7^^WU — ^rr^ 
40 M,B2{£<D>^^-2 (k,= 2k,) *WTSc 

[SI] 
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AS/C,= - f log|2 w | + ilog|E/| + ^loglS, 



+ 2 *(d + -y- ) logrt 



[0 0 3 5 ] fib, IS. |W^-f>F (IP*, n 

|Z,|tt*©^>F*©#21f:^*tf 

[0036]ffiot, 1 OtCfclir, 2o(D 

lf^1f>^;U (x» ,...,x, ) &tf (x,. t x n ) # 

(x, x.) <D^>F 

OttZf-y-fQ 1 5 7bS6 2 8 CC*j<,>T»gK b 

>CC^CD^W> F^fC*rt*4c*<o*>©B 1 C^X F# 

7*6 1 5CC*jl»-C, BlS»o©«l3W (n/r ) - KDffl 

feODf-X hWfbn^, Xf7 7'6 2 (HC*$C>Tffla# 

6 2 4tC*Jti-C. tf'iO* i 1 ) rCDfil 

CcRJEStlS. L*pU y^6 2 0{C*5^t, ffla 

5r^6 2 8fiCbl>?. i # r <DfilK:f8tf£3 *l 

[0 0 3 7 ] if^64 OtCfeC^r, i<DB 

4 OCCfc^T^V* iOfi^n- r *c90 < &C>C <!: 

* ^ > f *c*$ » 5 #<Dtr > ^ju tc#r £ mm* mmr 

n- rCC^U>C<h#^3ft£*§^ 9^660 
CCfaOT. B I Cffifctett*«/JN©» (A B I Co) tfi 

ft£„ ^7*6 6 O&C&t^T, B I cfflccfec^sg/h 
(Di(ABIC t .) #fiT&l>C£#ifcje3tlS»£. 
ft ^ > K ^*±gB^Sr#«"T 5/c*Or ^ 7* 
6 l o^l^iic, xf ^7 # 6 6 5Cc*jc^r i i;>f>K i 5 



cctawa^T©*^* i (cttT&AB I C <ii#it 
/c6T4><DT?frt>B^ ^>f^ -if^xn^tfftosti- 
[0 03 8] 60«:*J^t t B I C 
Xf^^6 7 0 CC*sl>r, i B ^-tey^>F»S<tl/-C 

l>^>F?<Dte£9#i,+ ^>F^- 
1MX#No(CK5£3*i, «fOt^^>F^* 

20 6 1 0K^£ o 

[0039] % i (D-r^rcopite* fitted or b 

I CiOfX Ftftrbtt* ®^ccd©cdaB I C,K:<fco 
r io#StR3*iS. *© l )-r>F«>"C«7U-A iCC 
*5l^T-fe^>F^#^«IHiWfi6r*i. ABIC i9 < 

*-f>FSCCM0T£a3*i*. HRCC. ^>F^« 
F«5St»w:«ttp-ria«©7-f-^+ FJKc<fco 

hiCittftl*. TsTvV 6 7 0 6C*5Ci"C-fe^> F* 
W^msti/ce#, F^tt3WB»*tiO*k/JMB 
(N 0 ) *t*5H-T4. 

[0 040] E. Bf^^F^iS 
40 *^H3(Dfc^ 1 ooi(#mj:n«, W?0-fe^> 
F CCfcC-t 4^»©««**a-r 4«f L C ^ > F ^ jgJR 

0 3 tiS -f > F •> • * XOJHRti^CCSS 

^>^> 0 «R3tifc-5^>F'?^May4t»^. 
[0041] hW^wanft^o/c^. 



15 

^(contextual informatio 

[0 04 2] ^^CDefcaStl/cby^O^-^a^ • 

l*a»«Ctt$-f> F$ • tMX*fco<fc**<*WWSl* 

jtef. /Mt^-f XcD^* FJND9-/> F£ (-« 10 

iST^/cabCC) , AN,=AN,. 1 + ^ 1 'r*4. fflU 5 
= 26\. a "C*£ 0 Chit ■)-f>Ff#ll*tLt* 
3C»«p(Ctt*a0iIt^-f> F^ ■ If ^XcDiittRtf* 20 

-f>F->3W**<a*K>ccttai^-f>F^ -*-yx© 
?n^, */h(D^-f>F i ? • t^xtfieflJUT*©* 

-f > F S #*©l*m S ftfc#JM>»«:*&* 4 - 
[0 04 3] F. BI C-f-X KDS**(Dtt^ 
#IS9l<Dfc 5 1 o<d«f«k: <£fttf, BICfxh jWt*> 
ft £ a - : ^ 3 ><0^J?3tci8tRfc <fc -o T&aB$R8:£{*<D 
•5^>K'>mSBICf'XKD5 

?\ bicw F«*^^>F^(0»lfcc*jc»r{iffto 
titter *tiB. *ti****cct>r*<cf r -* , c*>or 

ft. JtHKtctt, thBi«l»S^7*-7>xW> 

F*l*fc&<rO o 
[0 044] HCC, *g^> F C>B#«CB I Cf 

6ft4Scc % *(0^-r>F'>coBB>&mc*JCirB I Cit 
Ut^fiHafefftoftfcr**^. 10»O^-Y> 40 

f* •*^xfccfc^r»tao5»rtcc-fey^>F«w*« 
*BSftft*ofcJ|^ t l 0»©?l"5-r> F 

cfcor, *»]©5»rtCC«^52«>e>fti<tC^C4« 

ee^r, c^-r > K^a£SHcc«t 
< ) *-5-f >f-5©j**»jk:*jw4b i c«-»*j»ar 

&C<tCCj:^rB i c««o»*«^3**ci*«-c* 
5 0 39BCCtt % B I CW*<D**»tt* sfcfiiS 
ft 4 u^uocfEoTBHSS hfdHfiranfett y >* 

[0 04 5]S£ot, t^>f^3>'7 , OtX6 50 
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[0 04 6] G. BlC^f^^x-h 

b i cos:«, aifti^sccH-rijifflffjaiSfflioiHi 

F • *7*#it5A(DtAiltt 1 .3 r*5C 

CCB\ M.S. Thesis, Institut Eureeom i£ (7^>X % 
1 9 9 8) tCfetf S A. Tritschler fi;&t<fc& TB I C 
*ffifflOfc-b^>^-^a> • ^ F^/SBM 
T^'J^* — i^a> (A Segmentation-Enabled Speech Re 
cognition Application) J &®Lfcaft:£ : &#flBt/"Cl3t 

[0 04 7] JKM4LT, ffftAB^X^ftSOtOT 

[0 04 8] h. ^tr-^aafl^o-fe^ 

-«7'Di2^5 0 OB, Xf7 7*5 6 OCCfcl^T. 
07^$ft/cXt: < -^I^iJ^a'fe^7 0 0 *Htf U 
2»3ftfc*fc:-# ■ f-^-X4 2 0*«fflbt§ 

7*5 1 0«ctels-c^ii<D7D> F • x> F * V'u^v^r 

^>f*-^a> • ^Pir^60 OCCcfcoTfSSiJSftfc* 

-*-f-^-X420 (04) Cc-fe^y > F^W 

[0 04 9] ^->&l>*7 -f-^+ • F;^j % Xf 
vrfi l 0«:*jc»r. ©xtr-*tcj:4#^cr)f- + 

nSo ^7 2 occ*i»r. -fey^> f ^ 

ASrttl*T4tea>{Ctt, 0J£«, Proc. of Speaker Rec 
oqnition and Its Commercial and Forensic Applicati 
on, Avignon, France (1998) teCCtoWS H.S.M.Beigi 
ffcf6tC<fcS r [ BMtfJl • U-AgOX 
(IBM Model-Based and Frame-By-Frame Spe 
aker-Recognition) J <bHUfc8l&X*#flS0TaLl>o 
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[0051] i. xe-*wi (^ef^u • -^-x^a;) io 
[fk2] 



/ 



m=l M 



[005 2] CflfcO^fM*, tfVXMfiimiRZtl 

-3 -ciats? ft*. s^b-*ittn, 

a. 

[83] 

< 



M «; 



20 



30 



18 



&*Sli(fCCffl*<D?-;* h©*^ (S*# : C 1 a i m 
ant) *JBfiR-r*fc»«:#?f-fey^>h±#*s«fflS 

[0 05 5] J . *fcr-*7ttB5iJ • ^-X^ 

;l/ (GMM) <Dn,fflC!>:3>#-*> KDS^KStfTS 
C*4] 



[0 0 5 3 ] 2o(0*<D<fc5&^f r ^*tb«!['rSfc«> 
CC. Proc. ICASSP98 I£ (Seattle, WA, 1998) CCfcWS 
H.S.M. Beiqi ftfliUCj:* r^fl?cMR^»fflSIH©E* 

ais^cxxhr-*BWcstr**ti©jeffl (a Distan 

ce Measure Between Collections of Distributions an 
d Its Application to Speaker Recognition) J 

-#£Sii9ST£) . xtr-**ttE (^A'Stifcxtf 

- r (cohort) J "te ? h4^iU*JttSrr*C4 
ccj:or»»^SiiS'r^/c^(7)®2^ , x) , RWtf- 

[0 0 5 4 ] Xt-*Haa©fc«)K:**$hfc-tOgE* 



7« P j, ;} 



1 1j 



[0 05 6] cneotrw*, Bfr©-b^^a>tcte^ 
r^L/cfc^CC ria© <fc 9 & d &7C© • 

[»5] 



(7 



m=l M 



[0057] zf-xmrnmoy-j x&N.?$>zm 



C*6] 



{M(} i=l Np 



[0 0 5 8 ] #5£;©J:9&N<I©7 b 

<^U-Cl>S£<,>9J: 9ft i ilotfici, 

[»7] 



/- 



J n=l,..., /V 



[0 0 5 9 ] ;X©<fc9&7 u-a • ^-*©-?*- htt 



(11) 



2001-60098 



19 



20 



4= -log I /!] ftjp (/J j* component of Mi) 



[0 06 0] fit. sEm<D2k7jk*&m?Zt, ^©J:^ * [»9] 
tc&4. * 



[006 1 ] 7 s — &ip£> ©-t ^JUMi ©aftK 

[0 0 6 2 ] ftmotciblC. ^iz{fjt>b<D^7 : ^ 
• K©^©t,>Tft&-KKC-&gcL&t,>C<!:£ 20 

[ 0 0 6 3 ] &SE©;fc«>«C, ^^^^n/c^f-*©^ 

h &&l£t em^-fe 5- h©^ >M'*J«/ 7 ©^'.> i7 

«> gJj<# (C 1 a i ma n t ©^^l/^S/J^Bt^W 

[oo64] cvmmmmmz. xt-*iasiB©Hi 

[0 06 5] Xf';7"7 2OiCteUt&S?nfc-e0»l 
0St6h/cXf-*-7^HJ 1 Tie©<fc5K:. 
^Ul*-r-2./cS)(cff. ; gjM!RW(C^D7i'5 5 0 (0 
5 ) -v©fS3Efl«J««*s aJfc-C* 4 . X f- v 7 3 0 (Cte 

c^r. -?-©iijo^r e>n/t^t'-* • ^^jk*. xt*- 40 

*^-!S©ilimtC M L/ X m 2 /•? * £?f 5 C i (C «fc o "C tfcSE 

*-i4t§£. •?■©*£-# • ^mz*— y^<Dthj]<Dtc 

sbic7uv *5 5 0 (05) tc&fftSfta. HCC 
•y 7'7 4 0 (ctetsr . * 'J ^7-;u©g£§3 hfcx b'-*7 
• tf;i/*63f--f ■< * ■ 7-z b • -byjybtxom 
M%m-rmo%xt>titcz*T t&tc. mmvmiRzm 

0 «c tec > r e^s^w tcfpjsw set # Bjfilr * 4 . so 



[0 06 6] *Bg{Ctel,»Tra^3tlRC/0^$tl/<:||J6 

mftVK*<D&&imt£*m®<owmimi-?z box 

*4 C <t . RO'*^BJ©«'(il5S < Jl5HSO'ifS»^ 6 jW»"T 

*4c<t«a»sn4^#-c*4. 

[0 06 7] SiAiOt. *»W©«WE«:BOr|JlT 
©*^4B97nf4. 

[0068] (1) nXBac^-f^'V-x 

^e.^--r^tt$R ; SrlE^-r4fc&©^(CU-C. ituta 

-^tcteW4?#ae < j^-feyy> b&ft*mi?zx7v 

(2) iriais^^xT^^^ia*-^ * • y-* 

Klte^4&'7- KCCWLTi?-/ A ■ T7-/^>h4f#o 
fc<S¥4fP^-T 4 C t ^iii f 4W*JM 1 CCIBIS©^ 

( 3 ) imam* 4 * f- ? ^tt#ia«©tf *»»«Enii 

(4) mzm^XZXr- 7^BIS?tlfc^e-* • 

fc-fe > nc» 0 4 C 4 £#tfc i "T 4 ft jjai 1 K. 
IEiS©^ffi„ 

( 5 ) ttrieSJ 0 4 X t- v h?I2SJ 0 ^-ce ti/c X 
f-* • ^•^;U©ffffit4^^-rx3T^iiJ0^-C4^-r 

? ^"tHtcdtf c t nmt-rzimm 1 tctsts©* 

(6 ) wiBfuo^r4X7-^y«iuiasiJO^-c6nfex 

cctatg©^s. 

(7) Btria$KW4^T-^7\ WiW*^^*^. 
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(8) wiE^ij-rs^f v^tB ic^^miRmmz 
ffifflLr-tyy> vmft*m\?z>c tzmit-rzm 
mm i (cge«s©*j*. 

(9) loXBaSC^-f^'V-^W-f^ 
(a ) H&tetf-fv * • y-^fciK^LTmriB^-T*-/ 

(b) m&*-7<* • v-^tc^s^w^c-fe^y io 

>h«W««W!l-r4te«>{c. SO" (c) &!&55iJ3ttfc-fe 
^>hKXb'-# • ^;U£g«9i!5-CSA:tf>{C. flrfB 

(10) mrie^ 4-*+ ■ n> hMtKmsf) • r- 

z>ct*mmt?z> mmm 9 cc ib®©^. 
(id its iBftflM * • r-+fi'5=-+«B?riBim2 

(i2) maEm.w-?z?.7-v?um5tt--7 : <* ■ y- 

o fc«3?«l4f¥RW set <t -r sii*^ 9 tcieig 

d3) mwimrhx9-vf\ l timn.o^mm'K 

f^c^^Myvmwi) i ^-f : b'fi'C<jyaimuy u-a 
*fS6sij-r sci &#it <t t -sit mm 9 kbikd* & 

(14) anBM9£?sx???i*aftstift:xt;--*; 

ttfc-fe y y > h ccs j <o %x s c t iifffii -r sti*^ 9 

(15) »saw«3 3rix^»^«W8B»i»jar6tite 

f- ^*Etc*t?c i *«I*3I9 tciano^r 

a. 

(16) BtrtaSd <o%xz>Z7- v y'im&m *) e>4afc 
» o a-c s x f vv* jsccst? c t z%m. 1 1 h mm 

9 ICiBMOim. 40 

d7) mamt**?v-f\s& i Q,*<fhmmm> 
z&m b x * y ^ > f «if«rttsgr« c t trot £ -r z> 

(18) loxuistst©^—^ • v-xa>&ar-f 

^ *tf$R£ffcW&fca?>©v'X7-AK:i,T» 3>t'a- 
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^^tt#R©f-*^ F • 9 ic. m 

&®£W&Hz^> h^^Wf^J:^ St>'£!8 

^(c. ^^n^c^^ti-r^x^A. 

(19) 3>fa-^R*5(t3 BSt&bzfVWA ■ 3- 
3-F#K«> *- ^-f h • ^-^3> 

(2 0) loxtiHito^-f-ft' y-^^^-f 
^^■tf^^fE^-rs/cAo^-f-Atcor. 3>ba- 

ytctt^H^cite^sn, mriB=<>b-a-$^ax ! )^T 

•feu;^i, (iriB3>b-*-^^K«)nJtelt£3 

-f«. mmt-T" ■< tmm^y ■< -^-f • if 
*twu. ( i ) fttrffi^-TM ^- • y-^^e^brfr 

IB^-f r ^^t»$8©f-+^ F • ^-^ 3 >?r^fiS-r-5fc 
es?>tc. (ii) friB^-^-r * • y-XKtetf *»SEW«: 
h^J?£faSiJ-r£fc«>(C. SO* (iii) «W}Q 
snfct^yhic^f-*' 7ui>*>gw%x?>tcib 

A. 

(2 1) 3>f»-*fK*ro<3 Diffg^^ny^A • 3- 
(WlB3>bi---$ij!^IRtp'tiJSgAj:7'ny7A • 

3- f#I2«, frfB^--f : ^tf$R^e.y < • * 
t>hto%ft&rzz7-?yb. ( i ) miit-T'j* ■ 
v-xz&w-Lxmitt-f-t +«fg©7-+^ n • /<- 
^3>*fp-j)t-r-5fc«?)«c. (ii) itirtB:*- -■?*-< ^ • y- 

SO' (iii) «BWiJ3hfc-by>>Kc^t-* • 51 
JU^idOSTSfci&tc, miiBy ^ -5=-+ • ^y h;u*3 

(2 2) loX(JlliOt-f ^t' y-xwt-f 
•y^ttffH ; 5rf5'?-rS/cs!)©^CCL-r. mitt-?*-** 
1f$S©7"+X h • ^*-^3>*^rS/c«t>{CStfiB*- 

?4*' v-zzmwrzzf-vyt. mm*-?* * 
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24 



(2 3) loXtt»ft©*-f V-X*6*-f 

( i ) bme^-tw * • v-x*(£3f L/trariB*-^-/ 
i) mm*-?**' v-^«:*j»s»ft»tt-b^> 

h«W*WIW4te»«:, a» (iii) SiSWyShfc-fe 



10 



[0 3 ] 0 1 ©Xf-* • £ — > • r-^-X^CD 
[04] *JW«cJ:*R»Wft^fcr-*a»^a-fex* 
[0 5] Hl<0*-^-f *<E^SCX^fcf-*^MBS/X^ 

[0 6] 0 KD^-^^+R^acXXtr-^^JRi/^f* 
[07] 01(Dt-f^g?S^t-^II^f 
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